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(57) Abstract 

The present invention provides methods and systems to substitute alternative video and/or audio signals and/or graphics and/or text to 
be displayed on the viewer's television display monitor (1 50) for the video and/or audio signals that would otherwise be displayed according 
to the channel to which the viewer has tuned the television set (150). One aspect of the present invention provides methods and systems 
to replace and/or modify the advertisements that can be seen and heard by the television viewer. 



3 



fWf THE PURPOSES OF INFORMATION ONLY 
Codes used to identify States party to the PCT on the front pages of pamphlets publishing international applications under the PCT. 



AL 


Albania 


ES 


Spain 


LS 


Lesotho 


SI 


Slovenia 


AM 


Armenia 


FI 


Finland 


LT 


Lithuania 


SK 


Slovakia 


AT 


Austria 


FR 


France 


LU 


Luxembourg 


SN 


Senegal 


AU 


Australia 


GA 


Gabon 


LV 


Latvia 


SZ 


Swaziland 


AZ 


Azerbaijan 


GB 


United Kingdom 


MC 


Monaco 


TD 


Chad 


BA 


Bosnia and Herzegovina 


GE 


Georgia 


MD 


Republic of Moldova 


TG 


Togo 


BB 


Barbados 


GH 


Ghana 


MG 


Madagascar 


TJ 


Tajikistan 


BE 


Belgium 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


Turkmenistan 


BF 


Burkina Faso 


GR 


Greece 




Republic of Macedonia 


TR 


Turkey 


BG 


Bulgaria 


HU 


Hungary 


ML 


Mali 


TT 


Trinidad and Tobago 


BJ 


Benin 


IE 


Ireland 


MN 


Mongolia 


UA 


Ukraine 


BR 


Brazil 


IL 


Israel 


MR 


Mauritania 


UG 


Uganda 


BY 


Belarus 


IS 


Iceland 


MW 


Malawi 


US 


United States of America 


CA 


Canada 


IT 


Italy 


MX 


Mexico 


VZ 


Uzbekistan 


CF 


Central African Republic 


JP 


Japan 


NE 


Niger 


VN 


Viet Nam 


CG 


Congo 


KE 


Kenya 


NL 


Netherlands 


YU 


Yugoslavia 


CH 


Switzerland 


KG 


Kyrgyzstan 


NO 


Norway 


zw 


Zimbabwe 


CI 


Cote d'lvoire 


KP 


Democratic People's 


NZ 


New Zealand 






CM 


Cameroon 




Republic of Korea 


PL 


Poland 






CN 


China 


KR 


Republic of Korea 


PT 


Portugal 






cu 


Cuba 


KZ 


Kazakstan 


RO 


Romania 






cz 


Czech Republic 


IX 


Saint Lucia 


RU 


Russian Federation 






DE 


Germany 


U 


Liechtenstein 


SD 


Sudan 






DK 


Denmark 


LK 


Sri Lanka 


SE 


Sweden 






EE 


Estonia 


LR 


Liberia 


SG 


Singapore 







WO 99/11065 PCT/US98/17980 



SYSTEMS AND METHODS FOR REPLACING TELEVISION SIGNALS 

5 

FIELD OF THE INVENTION 

The present invention relates generally to television systems, and more 
particularly, to the interception of television programming signals tuned by a television 
and the replacement or overlay of said tuned television programming signals with 
10 alternative video and/or audio programming and/or with graphics and/or text. 

BACKGROUND OF THE INVENTION 

Historically, television viewers have controlled the tuning of the television and 
have consequently controlled the video display and audio sound of the television signal 

15 presented on the monitor and over the speakers of the viewer's television set. Early 
television sets were manually tunable; later, television viewers began to use infra-red 
remote control devices to change the channel to which the television was tuned. 

In the viewer-controlled-tuning environment, television programming is 
typically presented to the viewer over a commercial channel which interrupts the 

20 television program with paid-for advertisements. Sponsors pay a particular network or 
a particular channel to insert advertisements at scheduled times during the delivery of a 
particular television program. For instance, a fast-food hamburger restaurant chain 
might pay the FOX network a large sum of money to air a commercial advertisement 
for a ketchup-dripping hamburger for 30 seconds at a specified time during the 

25 nationwide broadcast of the SuperBowl. Typically, during a commercial interruption to 
a televised program, multiple commercial advertisements are shown, back-to-back. 

In the viewer-controlled-tuning environment, if the television viewer tunes the 
viewer's television to the channel that delivers FOX network programs to the viewer's 
television set, then the television viewer's television display monitor displays the 

30 SuperBowl game during the time scheduled for the airing of that game. During the 

time that the FOX network transmits coverage of the SuperBowl game event, the FOX 
network schedules interruptions in the delivery of the program for commercial 
advertisements. During the scheduled advertisements, if the viewer does not change 
channels, then the viewer's television set displays the scheduled advertisements on the 

35 viewer's television. 

Many viewers do not want to watch the particular advertisements that are shown 
during the scheduled commercial interruptions. Such viewers might change channels, a 
process often referred to as "channel surfing," during the commercial break. The 
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channel surfing viewer must guess how long the commercial break will last, so that the 
viewer can finally change channels back to the FOX network in time to watch the 

5 continuation of the SuperBowl game. 

Historically, television sets were "dumb" terminals that, when tuned to a 
particular channel, displayed on the display monitor the visual representation of the 
analog television signals tuned by the said television tuner. In contrast with older 
"dumb" television sets, many modern television sets are equipped with sophisticated 

10 and powerful programmable microprocessors and provide significant Random Access 
Memory ("RAM") and Read Only Memory ("ROM"). Increasingly, modern 
microprocessor/RAM/ROM equipped television sets are programmed with an Electronic 
Program Guide ("EPG"). 

As an alternative to channel surfing during commercial breaks, some viewers 

1 5 activate the EPG to view the schedule of upcoming programs on other channels. 
Recent innovations to Electronic Program Guides ("EPG"s) provide viewer-to-EPG 
interaction improvements and provide Picture-In-Guide ("PIG") display of the 
television program simultaneous with the display of the EPG. International Application 
No. PCT/US95/11173 (International Publication No. WO 96/07270), the disclosure of 

20 which is incorporated by reference herein for all purposes, illustrates such an 

improvement. Further innovations to EPGs provide for multiple "windows'* in the 
EPG display that allow the viewer to simultaneously, among other things: continue 
watching the currently tuned channel, navigate the programming schedule for the 
channels available to the-viewer's television, and watch multiple additional modes of 

25 advertising. U.S. Patent Application No. 09/120488, Attorney Docket No. 

32714/LTR/E190, the disclosure of which is incorporated by reference herein for all 
purposes, illustrates such improvements. 

One of the many improvements disclosed in U.S. Patent Application No. 
09/120488, Attorney Docket No. 32714/LTR/E190 is the collection of extensive 

30 information concerning a particular viewer, described there as a viewer's profile. Also 
described in U.S. Patent Application No. 09/120488, Attorney Docket No. 
32714/LTR/E190 is the utilization of a viewer's profile to customize the presentation to 
the viewer of advertisement. In that invention, the presentation of advertising is 
customizable for every mode in which advertisement is presented to the viewer. 

35 including but not limited to the customization of advertising presented as part of the 
EPG display and the customization of advertising delivered by the television tuner. 



-2- 



WO 99/11065 



PCTAJS98/17980 



SUMMARY OF THE INVENTION 

The present invention provides methods and systems to substitute alternative 

5 video and/or audio signals and/or graphics and/or text to be displayed on the viewer's 
television display monitor for the video and/or audio signals that would otherwise be 
displayed according to the channel to which the viewer has tuned the television set. 
One aspect of the present invention provides methods and systems to replace and/or 
modify the advertisements that can be seen and heard by the television viewer. 

10 In one embodiment, the present invention uses an EPG as a platform with 

which to execute the innovations described herein. However, the invention is not EPG 
platform dependent. That is, for some embodiments of the present invention, it is not 
necessary that the viewer interact with an EPG. Furthermore, for some embodiments 
of the present invention, it is not necessary that the sophisticated interactive display 

15 system of an EPG be available on the viewer's television. That is, according to one 
aspect of the present invention, alteration of the selection and display of advertisements 
seen and heard by the television viewer is independent of any viewer profile 
information and is independent of the viewer's interactivity with, or even the existence 
of, an EPG. 

20 According to one aspect of the present invention, an EPG generating system is 

optionally programmable to block the audio and video of the program currently being 
viewed when the EPG is activated. 

According to another aspect of the invention, audio and/or video blocking is 
activated according to either selected channels or selected shows being viewed when 

25 the EPG is activated. 

According to yet another aspect of the invention, a blocking bit located in either 
a channel table or show table entry is set remotely to control blocking audio and/or 
video blocking of either a selected channel or a selected show being viewed when the 
EPG is activated. 

30 According to still another aspect of the invention, an advertisement or message 

is displayed on the EPG to replace the audio and/or video being blocked. 

According to another aspect of the invention, the viewer's television is tuned, in 
a manner invisible to the viewer, to a second channel for a certain period of time, and 
is then tuned to the first channel. 
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DESCRIPTION OF THE DRAWINGS 
5 These and other features, aspects, and advantages of the present invention will 

become better understood with regard to the following description, appended claims, 
and accompanying drawings where: 

FIG. 1 is a schematic diagram of the hierarchical database utilized to generate 
an EPG. 

10 FIGS. 2 A and 2B are schematic diagrams of the data structures in an EPG 

database for an EPG embodiment of the present invention. 

FIG. 3 is a flow chart of one embodiment of the steps for activating audio 
and/or video blocking. 

FIG. 4A is a schematic diagram depicting an EPG display on a television 
15 monitor wherein the EPG display overlays a portion of the real time video display of 
the television signal. 

FIG. 4B is a schematic diagram depicting an EPG display on a television 
monitor wherein the EPG display overlays the entire real time video display of the 
television signal. 

20 FIG. 5 is a schematic diagram depicting the Head End Channel Change aspect 

of the present invention. 

FIG. 6 is a flow diagram of the Head End Channel Change process at the head 

end. 

FIG. 7A-is-a schematic-diagram of-a-television system with a single-signal 

25 receiver/tuner. 

FIG. 7B is a flow diagram of the Head End Channel Change process at the 
viewer's television set. 

FIG. 8 is a schematic diagram of a television system with two signal 
receivers/tuners. 

30 FIG. 9 is a flow diagram of one embodiment of the Television Channel Change 

process with the components necessary for the EPG Viewer Profile Implementation. 

FIG. 10 is a graphic representation of a sample screen display of an interactive 
Electronic Program Guide with a Program-In-Guide Window for display of the real 
time video signal. 

35 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention provides for the capability to alter what a television 
viewer watches without the viewer changing channels. One application of the present 
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invention is to alter the advertisement that the viewer sees displayed on the viewer's 
television display monitor. 

5 One scenario in which this application will prove useful is where a television 

network wants to target advertisements. Consider for example, a network, e.g.. FOX. 
that is delivering nationwide real-time coverage of a major event, such as the 
SuperBowl. Historically, advertisers paid large sums of money for an advertisement to 
be delivered at a certain time during a commercial break in the SuperBowl coverage. 

10 The networks historically delivered several advertisements, typically ranging in duration 
from 15 seconds to 60 seconds, back-to-back during a single commercial break. In 
contrast to the historical, serial advertising model used by networks, the present 
invention enables advertisement multi-casting. That is, the present invention will 
provide systems and methods that will allow a network to set up multiple channels of 

15 advertising, e.g., FOX, FOX1, FOX2, etc. Each channel could provide a separate 

program of advertising synchronized in time to coincide with advertising delivered on 
the main channel, e.g., FOX. Using the present invention, the television set of an 
individual viewer who is watching the SuperBowl on FOX, will be automatically tuned, 
in a manner invisible to the viewer, to one of the multiple FOX channels during a 

20 commercial break. In one embodiment, the television set automatically tunes in a 
serial manner to one or more of the multiple FOX channels. 

The criteria for selecting the channel to which a particular viewer's television 
will be tuned may consider an individual viewer's profile, or may be based on some 
other criteria, to be defined by the network. Some of the possible criteria used to make 

25 such selections are described further later in this application. 

The present invention is not limited to a particular set of selection criteria. On 
the contrary, the present invention discloses that such selections are definable, using 
such approaches as are known in the art, as with table-driven software programs and/or 
database driven criteria selection. The data contained in the tables and/or databases 

30 that would drive the selection criteria may be based, as has already been mentioned, on 
the viewer's individual profile. However, the selection-driving tables and/or databases 
may also contain other types of data, such as the geographical location and 
corresponding time of day when the viewer will receive the television signal. 
Furthermore, the selection-driving criteria is not limited to automated methods. 

35 This application repeatedly refers to "tuning" a television to a particular 

"channel." In this application, the term "channel" includes, but is not limited to, such 
conventional methods of video and audio communication as television channels, cable 
channels, and satellite channels. Furthermore, the term "channel" also includes other 
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methods of video, audio and other types of communication, including but not limited to 
Internet website addresses and external data sources. 

5 The present invention may be implemented on a personal computer, a PCTV, a 

television connected to a set-top box, a television including a microprocessor, or other 
such devices. The disclosure of U.S. provisional patent application No. 60/057,089, 
titled "ELECTRONIC PROGRAMMING GUIDE INCLUDING AUDIO AND/OR 
VIDEO BLOCKING FUNCTION" is incorporated by reference here as if fully stated 

10 herein for all purposes. However, the invention is not limited to any particular 

hardware configuration or to any particular television system and will have increased 
utility as new combinations of computers and television systems are developed. For 
instance, the invention is not limited to conventional analog television, and applies 
equally to digital television and computer configurations. 

15 A. Head End Channel Change 

According to one aspect of the present invention, the head end delivery provider 
monitors the outgoing television programming signals. This aspect of the invention 
will be referred to as "Head End Channel Change." FIG. 5 is a schematic diagram 
depicting the Head End Channel Change aspect of the present invention. FIG. 6 is a 

20 flow diagram of the Head End Channel Change process at the head end. FIG. 7A is a 
schematic diagram of a television system with a single signal receiver/tuner. FIG. 7B 
is a flow diagram of the Head End Channel Change process at the viewer's television 
set. 

Monitoring at-the head end 110-may-be done electronically or manually. 

25 According to a pre-established criteria, the head end deliver)' provider inserts a channel 
change command in the vertical blanking interval ("VBI") of one or more channels. 
Optionally, the channel change command is accompanied by a duration, expressed, for 
instance, in seconds. The pre-established criteria for the VBI channel change command 
insertion can be based on, for instance, a schedule of advertisements as identified in a 

30 channel, program and advertisement scheduling table. Alternatively, the head end 

delivery provider interrogates the outgoing signal and detects a particular event, such 
as, for instance, a change from television programming to commercial advertising. The 
channel change command instructs the receiving television set to tune to a particular 
channel. 

35 In one embodiment of Head End Channel Change, the head end delivery 

provider monitors 1 10 the outgoing television programming signals of a particular 
channel, Channel A. The channels that are to be monitored are defined to the head end 
by data in a table or a database 130. The head end monitor determines whether a 
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particular channel is to be intercepted 310. When the monitored channel begins 
delivering advertising, the head end provider checks a table or database 140 that 

5 contains information necessary to determine whether a particular advertisement should 
be intercepted 320 with a channel change command. The table and/or database 140 
would contain, among other things, the channel, time, and channel change information. 
This collective information is sometimes referred to below as "channel and advertising 
intercept database information." If the head end provider determines that the 

10 advertisement should be intercepted, then the head end provider inserts a channel 

change instruction in the VBI 325 that instructs the receiving television to change to a 
second particular channel, Channel B. That is, the timing of the insertion of the 
channel change command in the VBI is coincident with the beginning of an 
advertisement. Channel B delivers alternative advertisement and/or television 

15 programming synchronized in time with Channel A's delivery of advertising. 

Televisions are equipped with a microprocessor programmed to recognize the channel 
change command and to tune the television to the channel indicated in the VBI 
command. 

In an alternative embodiment, the head end inserts 325 a channel change 

20 command in the VBI but does not specify the particular channel to which the television 
should tune. In this embodiment, the television microprocessor will determine, based 
on information available to the television system, including but not limited to. viewer 
profile information, an advertising database, and other types of information, to which 
channel the television should tune. 

25 FIG. 7A is a schematic diagram of a television system with a single signal 

receiver/tuner. FIG. 7B is a flow diagram showing the Head End Channel Change 
process at the viewer's television set. The television receiver 210 receives the input 
television signal. The television receiver 210 includes a tuner. The television receiver 
sends the television signal to the VBI decoder 235 to decode the information carried in 

30 the VBI of the signal. The VBI decoder 235 sends the decoded VBI information to 
the microprocessor 240 for analysis. 

Consider then, a particular viewer's television set that is tuned to Channel A. In 
the Head End Channel Change environment, when the viewer's television set receives a 
change channel command in the VBI of Channel A 600/610, the television system is 

35 programmed to execute the change channel command and instruct the television tuner 
to tune to Channel B 620. If the VBI channel change command is accompanied by a 
duration component, then the television is programmed to leave the television tuned to 
Channel B for the duration expressed in the VBI command (the "Channel B duration") 
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640. At the expiration of the Channel B duration, the television is programmed to tune 
the television to Channel A 650. In one embodiment of this aspect of the invention 

5 (the "Manual Intervention" embodiment), if the viewer intervenes with the Head End 
Channel Change sequence and instructs the television to change to a particular channel, 
for instance, Channel C, then the television is programmed to ignore the expiration of 
the Channel B duration. In such a Manual Intervention embodiment, the television will 
remain tuned to Channel C even after the expiration of the Channel B duration. In 

10 another embodiment, the television is programmed to ignore the viewer's manual 

intervention, and retunes the television to Channel A at the expiration of the Channel B 
duration. In an alternative embodiment, the head end continues to monitor the 
advertisement on Channel A. When the head end determines that the advertisement is 
finished on Channel A, the head end inserts a channel change command in the VBI of 

15 Channel A to instruct the viewer's television to return to Channel A. In this 
embodiment, the television is monitoring Channel A, even though the viewer is 
watching Channel B. 

The channel change instruction will be implemented if the viewer is watching 
the television in television mode. In this application, television mode refers to the 

20 operation of a television whereby the viewer is watching the television with the 

television display fully occupying the television's display monitor, and during a time 
when real-time television signals (as opposed to recorded video signals) are displayed 
on the television. Furthermore, the channel change instruction will also be 
implemented if the viewer -is-in- the-EPG mode - In this applicationrEPG mode refers 

25 to the operation of a television whereby the viewer has activated the EPG and some on 
screen display, formatted by the EPG, is apparent on the television display monitor. 
As mentioned above, many modern EPGs use what is know as a Picture-In-Guide 
("PIG") Window. That is, when the television is operating in the EPG mode, the 
television signal for the channel to which the television is tuned is displayed in a 

30 "Window," the Picture-In-Guide Window, such as a fixed position area of the on 
screen display of the television monitor. FIG. 10 is a graphic representation of a 
sample screen display of an interactive Electronic Program Guide with a Program-In- 
Guide Window 12 for display of the real time video signal. Implementing a channel 
change instruction when the viewer is in the EPG mode in the case where the EPG 

35 provides for the television signal to continue to be displayed in the PIG Window, 12 
will cause the PIG display to reflect the changed channel in the PIG Window 12. 

Consider as an example that the SuperBowl is being telecast on Channel A. 
Channel A interrupts the televised delivery of the SuperBowl to deliver several 
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scheduled advertisements back-to-back. The head end detects the change in the 
television signal to signify that an advertisement is being delivered. The head end 

5 checks the information available to it, such as the channel and advertising intercept 
database information described above, to determine whether the advertisement should 
be intercepted. If so, the head end immediately inserts an instruction in the VBI of 
Channel A to tune to Channel B. 

In this example, a viewer is watching the SuperBowl on the viewer's television 

10 set that is tuned to Channel A. Channel A interrupts the SuperBowl program to show a 
beer commercial. The viewer's television is programmed to recognize and execute the 
VBI change channel command. When the viewer's television encounters the VBI 
change channel command, the viewer's television tunes to Channel B. Channel B 
shows a commercial for a nationally recognized brand of athletic shoes. When the 

15 commercial on Channel B is complete, the viewer's television is programmed to return 
to Channel A. The change of channels is invisible to the viewer. 

Alternatively, when the television set tunes to Channel B. Channel B provides a 
mixture of commercial and non-commercial programming related to the SuperBowl, 
such as athlete interviews and team endorsed sports equipment. The viewer's television 

20 is programmed to tune to Channel A at the conclusion of the mixed commercial and 
non-commercial programming on Channel B. 
B. Television Channel Change 

According to another aspect of the present invention, the television system is 
programmed to monitor the television programming signals tuned by the television. 

25 FIG. 9 is a flow diagram of one embodiment of the Television Channel Change process 
with the components necessary for the EPG Viewer Profile Implementation. According 
to a pre-established criteria, the television set instructs the television to change channels 
(the "Television Channel Change"). Optionally, the channel change command specifies 
an express duration in time. The pre-established criteria to change channels can be 

30 based on, for instance, a schedule of advertisements as identified in a channel, program 
and advertisement scheduling table maintained in RAM (the "advertising schedule 
database") 510 and 530. In an embodiment where the advertising schedule database is 
maintained in RAM, the data content of the advertising schedule database is updated 
through some manner recognized in the art, for instance through transmission of 

35 database updates through the VBI. Alternatively, the advertising schedule database 510 
and 530 may be maintained at a location addressable by the television, such as on the 
Internet. The advertising schedule database contains an entry for each advertisement 
that is to be intercepted. Each entry specifies, among other things, the channel which 



-9- 



WO 99/11065 



PCT/US98/17980 



is scheduled to carry the advertisement to be intercepted (Channel A), the start time of 
the advertisement to be intercepted, the channel (Channel B) to which the television 
should be tuned, and, optionally, the duration of time for which the television should 
remain tuned to Channel B. 

Alternatively, the pre-established criteria to change channels can be based on 
certain changes detected in the tuned television signal. For instance, the television 
interrogates the tuned signal and detects a particular event, such as, for instance, a 
change from television programming to commercial advertising. This process is 
similar to the process flow diagram in FIG. 7B. When the television detects such a 
pre-defined event, the television instructs the tuner to change channels to a particular 
channel. In one embodiment of the Television Channel Change, the television builds 
the instruction to change channels from information located in the advertising schedule 
database described above. In another embodiment of the Television Channel Change, 
the television builds the instruction to change channels from information located in the 
relevant Channel Data Table entry and/or Show List entry as are described in detail 
later in this application and from the corresponding entry in the advertising database 
also described in detail later in this application. 

As was previously mentioned, a channel change instruction will be implemented 
if the viewer is watching the television in television mode. Furthermore, a channel 
change instruction will also be implemented if the viewer is in the EPG mode, causing 
the PIG display 12 to reflect the changed channel in the PIG Window 12. 

In-an-alternative-embodimentv the television-is equipped-with two tunersr FIG.-8- 

is a schematic diagram of a television system with two signal receivers/tuners. In this 
embodiment, rather than maintain a duration time for each commercial to be 
intercepted, the television uses one tuner to tune to the Channel B; the television uses 
the second tuner 280 to monitor, as was previously described above in this application 
in connection with Head End Channel Change, the Channel A to determine when the 
advertisement is finished. When the second tuner 280 detects that the advertisement is 
finished, the second tuner 280 instructs the television to display Channel A on screen. 
This can be implemented in one of two ways. One way is to instruct the television to 
use the first tuner to tune to Channel A. The second way is to switch the control of 
the on screen display from the first tuner, which is tuned to Channel B, to the second 
tuner which is already tuned to Channel A. 
C EPG Implementation 
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According to another aspect of the invention, changes to the television signal 
that the viewer watches are only implemented if the viewer activates the EPG. This 
5 aspect of the invention is referred to as the ''EPG Implementation." 

In the EPG Implementation, a Data Base Engine ("DBE") builds a database in 
RAM. FIG. 1 depicts a hierarchical structure of such a database. In one embodiment, 
the database is structured internally as schedule data structures and theme data 
structures linked by handles and handle tables. Each handle is an index to a handle 
10 table which contains pointers to blocks of memory where structures of the database are 
stored. 

In one embodiment, the hierarchy of the schedule data structures, in descending 
order, is: 

Channel Data Table: contains subscriber unit's list of channels; 
1 5 Show List: contains time slots for each show scheduled to be 

broadcast for a channel; 
Show Title: contains the title text and show title attributes: 

Show Description: contains the show's ratings, attributes, and description 

text. 

20 

A channel data table, as depicted in FIG. 2A, is the highest level data structure 
in the depicted hierarchy. This table includes an entry for each channel received by the 
viewer's television. The entries in the channel data table are changed infrequently and 
are determined by the location of the subscriber unit and type of services received. 

25 Each channel data table entry includes information concerning the channel and a handle 
to a show list handle table for the channel. Additionally, in the EPG Implementation, 
the channel data table includes an audio blocking bit ("ABB"), and a video blocking bit 
("VBB") which are set by commands received by the DBE. 

The next data structure in the hierarchy, as depicted in FIG, 2B, is the show 

30 list. The show list includes a start time typically being midnight GMT and 24 hours of 
scheduling. The channel's schedule is given by an ordered sequence of show slots, 
with a show slot for each show to be broadcast by a particular channel for a particular 
day. Each slot includes a duration, show title handle, and show description handle. 
Finding an entry corresponding to a given start time requires the entries to be scanned. 

35 in order, from the beginning of the show list and adding duration values. In the EPG 
Implementation, the show slots include an ABB and a VBB. 
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In one embodiment of the EPG Implementation, the ABB and VBB in both the 
Channel Table Entries and the Show List Entries are accompanied by additional 

5 information, including pointers to entries in the advertising database described below. 

In addition to the above-described program scheduling data, one embodiment of 
the EPG Implementation provides for the creation and maintenance of an advertising 
database at the local television system. The advertising database will contain 
advertisements comprising video, audio, graphics and/or text components. The 

10 advertising database may also contain instructions to tune to a particular channel. The 
channel-tuning instructions will be used by the system to tune the television to channels 
which provide advertising. 

In one embodiment of the EPG Implementation, the present invention uses the 
audio blocking bit ("ABB") and video blocking bit ("VBB") in the channel ID entries 

15 in the channel data table and the show list entries in the show list data structures 

described above and depicted in FIGS. 2 A and 2B to determine whether to block the 
video and/or audio signals currently tuned by the viewer's television set. FIG. 3 is a 
flow chart of one embodiment of the steps for activating audio and/or video blocking. 
The values saved in the ABB and VBB data fields will have been previously set for 

20 each channel and each show. FIG. 4A is a schematic diagram depicting an EPG 

display on a television monitor wherein the EPG display overlays only a portion of the 
real time video display of the television signal. FIG. 4B is a schematic diagram 
depicting an EPG display 405 on a television monitor 400 wherein the EPG display 

overlays (blocks)- the entire real-time-video-display of-the-television- signal. 

25 When the user activates the EPG. the EPG checks the VBB of the channel table 

entry of the channel currently tuned prior to the viewer entering the EPG. In one 
embodiment of the EPG Implementation, if the VBB in the channel table entry of the 
currently tuned channel is set "on," then the EPG display is adjusted to completely 
cover the screen. That is, the show being viewed is completely blocked out. 

30 Similarly, the ABB for the currently tuned channel is checked. If the ABB in 

the channel table entry of the currently tuned channel is set "on," then the EPG blocks 
the audio portion of the currently tuned channel when the viewer enters the EPG. That 
is, if the signal provided to the television system is modulated onto channel 3/4 output, 
then the audio signal is not modulated onto the output signal. 

35 If either audio and visual blocking is activated, then the above-described 

advertising database is accessed. In one embodiment of the EPG Implementation, the 
system accesses the advertising database according to a preprogrammed set of 
instructions that would be dependent upon criteria, including, but not limited to: the 
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time of day; the day of the week; the type of program that the viewer was watching 
immediately before activating the EPG: and/or, the channel to which the viewer was 

5 tuned immediately before activating the EPG. The preprogrammed set of instructions 
determines the appropriate advertisement to display in the appropriate window and/or 
windows of the EPG display. The preprogrammed set of instructions could further 
utilize viewer profile characteristics to determine the appropriate advertisement to 
display on the viewer's television monitor. 

10 In another embodiment of the EPG Implementation, the ABB and VBB in both 

the Channel Table Entries and the Show List Entries are accompanied by additional 
pointers to entries in the advertising database 535 described above. In this 
embodiment, if either the ABB or VBB are set "on," then the system accesses the 
advertising database as instructed by the pointers associated with the ABB and/or VBB. 

15 The system then uses the advertising data, whether video, audio, graphics, text, or a 
command to tune to another channel, to present alternative advertising to the viewer, 
either in the PIG display window, or in some other window or display device of the 
EPG. Alternatively, the alternative advertising data is accessed by a link to the 
Internet. Alternatively, the alternative advertising data, including video, audio, 

20 graphics, and/or text, is delivered by the EPG provider from the head end. e.g., 
through the VBI. 

D. EPG Viewer Profile Implementation 

According to still another aspect of the invention, changes to the television 
signal that the viewer watches are only implemented if the television provides an EPG 

25 and if the EPG is programmed to customize advertising based on the collection of data 
known as the Viewer Profile. This aspect of the invention is referred to as the "EPG 
Viewer Profile Implementation." U.S. Patent Application No. 09/120488, Attorney 
Docket No. 32714/LTR/E190, the disclosure of which is incorporated by reference 
herein for all purposes, discloses the collection of Viewer Profile data. The EPG 

30 Viewer Profile Implementation is not necessarily dependent upon the viewer actually 
activating the EPG. 

In one embodiment of the EPG Viewer Profile Implementation, the television 
system uses Viewer Profile information 520 to customize the presentation and/or 
scheduling of telecast advertisements that are viewable during the real time telecast of 
35 the television program that the viewer is watching. One example is customizing an 
overlay message to an advertisement on a local geographic basis. For instance, the 
geographic location of the individual viewer is known to the television system. The 
broadcaster or head end can packet match on the zip code to customize the message so 
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each zip code gets a different message, i.e., the 3 Burger Kings in the viewer's local 
area. In one embodiment, the customized messages can be preloaded by zip code into 

5 the memories of particular viewers' television system, as through an EPG. The 

preloaded messages can be transmitted by a head end during off hours and stored in the 
viewer's terminal for use when the advertisement runs, e.g., during a television 
program or in a video clip in the Ad Window 14 and/or 16. The electronic trigger to 
run the message can be transmitted along with the television signal in real time and can 

10 identify the messages stored in the user terminal that need to be applied. 

In another embodiment of the EPG Viewer Profile Implementation, the 
customized messages are narrowcast, according to viewer profile information 
maintained at the head end, with the televised advertisement. One way to narrowcast 
the customized messages is to embed the customized information in the advertisement 

15 video stream. Another way is to transmit a digital '"watermark" in the video stream of 
the advertisement. 

In one embodiment of the EPG Viewer Profile Implementation, customization 
of real-time viewing of advertisements is achieved by providing multiple channels of 
advertising, by tuning the television automatically to a particular advertising channel at 

20 the time during the telecast of the television program during which an advertisement is 
scheduled to occur, and by then tuning the television back to the viewer's chosen 
television program at the conclusion of the advertisement. In the EPG Viewer Profile 
Implementation, the EPG determines, based on the Viewer Profile 520, to which of 
_ _ m ultiple alternative advertising channels the- television should be instructed to tune. - 

25 In another embodiment, a service monitors telecasts for advertisements as they 

are telecast on a particular channel and, based on the viewer profile information 
maintained at the head end 1 60, inserts a change channel command in the Vertical 
Blanking Interval (the "VBI") when an ad is telecast, said change channel command 
causing the television to tune to a particular channel. Alternatively, the head end 

30 inserts the change channel command, and the EPG at the viewer's television determines 
to which of multiple possible alternative advertising channels the television should be 
tuned according to the Viewer's Profile 520. 

In this application, the term Viewer Profile includes all aspects of the viewer 
that can be collected by the EPG, and includes, but is not limited to, the information 

35 described as viewer profile data, viewer profile characteristics, viewer profile 

information, and/or viewer profile in U.S. Patent Application No. 09/120488. Attorney 
Docket No. 32714/LTR/E190, and includes as well, the "access-contenf information 
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model, the "adjacent-content" information model, and the "history of use" information 
model described therein. 

5 The EPG can select advertisements from various possible locations, including 

but not limited to: a library of advertisements 535 stored at the viewer's terminal in 
RAM, that have been downloaded through the VBI, stored at the head-end. or 
accessible through an EPG link to the Internet/ World Wide Web. The advertisements 
535 may be in the form of graphics, text, video clips, audio clips, and combinations 

10 thereof. Each advertisement can be assigned theme codes, profile codes, and other 
selection intelligence. In one embodiment, in order to customize the advertising 
display, the EPG searches the library of available advertisements to locate 
advertisements that match criteria set by the advertisers for "access content." ''adjacent 
content," "history of use," and/or Viewer Profile information. In another embodiment. 

15 the EPG selects advertisements for display according to pre-established selection 
criteria. 
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Illustrative Embodiments 

The embodiments of the invention described herein are only considered to be 
preferred and/or illustrative of the inventive concept; the scope of the invention is not 
to be restricted to such embodiments. Various and numerous other arrangements may 
be devised by one skilled in the art without departing from the spirit and scope of this 
invention. For example, the invention applies equally to digital television as it does to 
conventional analog television. 
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CLAIMS: 

1. A method for substituting alternative video and/or audio signals and/or 
5 graphics and/or text to be displayed on the viewer's television display monitor in the 
place of the video and/or audio signals that would otherwise be displayed according to 
the channel to which the viewer has tuned the television set, comprising the steps of: 

monitoring at the head end provider an outgoing television signal for a first 
particular channel; 

10 identifying the point in said outgoing television signal at which said signal 

begins to carry advertising information; 

inserting in said outgoing television signal on said first particular channel an 
instruction to any television that receives said television signal to change channels. 

15 2. The method of claim 1, wherein said instruction to change channels 

identifies a second particular channel. 

3. The method of claim 2, wherein said instruction to change channels 
includes a duration of time. 

20 

4. The method of claim 3, further comprising the steps of: 

receiving said television signal at a viewer's television set on said first particular 
channel; 

recognizing said instruction at said viewer's television set to change channels; 
25 tuning said viewer's television set to said second particular channel for said 

duration of time; 

tuning said viewer's television set to said first particular channel. 

5. A system for substituting alternative video and/or audio signals and/or 
30 graphics and/or text to be displayed on the viewer's television display monitor in the 

place of the video and/or audio signals that would otherwise be displayed according to 
the channel to which the viewer has tuned the television set, comprising: 

means at the head end provider to monitor an outgoing television signal for a 
first particular channel; 
35 means to identify the point in said outgoing television signal at which said 

signal begins to carry advertising information; 

means to insert in said outgoing television signal on said first particular channel 
an instruction to any television that receives said television signal to change channels. 
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6. The system of claim 5, wherein said instruction to change channels 
identifies a second particular channel. 

5 

1. The system of claim 6, wherein said instruction to change channels 
includes a duration of time. 

8. The system of claim 7, further comprising: 
10 means to receive said television signal on said first particular channel; 

means at a viewer's television set to recognize said instruction to change 
channels; 

means at said viewer's television set to tune to said second particular channel 
for said duration of time; 
15 means at said viewer's television set to tune to said first particular channel 



20 



25 



30 



35 



-18- 



WO99/1106S PCT/US98/17980 



1/11 



FIG.1 



CHANNEL OATA TABLE SHOWLIST HANOLE TABLE SHOWUST 



















CHANNEL ID 




OxEE 


• 
• 








• 


SHOWUST HANDLE 
TABLE HANOLE 


1 


MONDAY SHOWLIST HANDLE 


_] 


TITLE ENTRY HANDLE 






• 

• 


TUESOAY SHOWUST HANDLE 


DESC. ENTRY HANDLE 






• 


GAP ID 


• 
• 
• 


• 
• 
• 


SUNDAY SHOWLIST HANDLE 


OxFF 


SIO HASH TABLE 






SHOW TITLE HANDLE TABLE 






SHOW TITLE ENTRY 
















REF CNT 
THEME ID 






12 MSB SID 


TEST 




SHOW TITLE HANDLE 
TABLE HANDLE 


SHOW TITLE ENTRY HANDLE 










DID HASH TABLE 






SHOW DESC HANDLE TABLE 






SHOW DESC. ENTRY 
















REF CNT 
THEME ID 




8 MSB DID 


TEST 


SHOW DESC HANDLE 
TABLE HANDLE 


SHOW DESC. ENTRY HANDLE 















SUBSTITUTE SHEET (RULE 26) 



WO 99/11065 



PCTAJS98/17980 



2/11 



CM 



in 



CO 



2 
O 

UJ 

2 



cr 
< 



CO 





o 




CN 




M* 




(D 










o 


o 


o 




o 




O 










X 


X 


X 




X 




X 










o 


o o 




o 




O 












u. 






CD 




CD 




CD 
















CO 




00 




CO 


cr 








r- 






—I 




—J 




-1 


Ul 








o 








1 


i 






z 






UJ 


TT 
o 








-J 

Q 






PO 






OXE 


o 
u. 




OLE 


HAN 






CD 
CD 
> 




IXFF 


fl 


0- 




z 
















cr 

UJ 


PV GR 


z 


MA 


NOIidl 


9 


CK 

UJ 




II 

cr 


MIT 


ATK 


UJ 
-J 


UP 


liNIOc 




IMITE 


_j 




cr 


t— 


a: 


o 




UJ 






I— 


o 


cr 


LA. 




i 


o 




o 






o 


CD 




UJ 

o 


1— 
or 






O 
X 


a 










o 


STA 






(/) 


OW 






BB 




EN 










: 


c 






> 








AS 








CO 
















m 




CD 




CD 




VBB 








UJ 




CO 




00 




CO 










cr 




2 




2 




2 











O *~ CM fO 

O O O O 

x x x x 

O O O O 



fs 00 O) < O UJ 

o o o o o o 

x x x x x x 

o o o o o o 



UJ 



CD 
< 



5 



CM 



to 



to 



CM *0 
O O 
X X 

O O 



^ m (D n co ox a 

ooooooo o 

xxxxxxx x 

ooooooo o 



X 

o 



Ul 

z 
z 
< 

X 

o 



CJ 



UJ 

—I 



I- 

$2 



CO 

—I 

o 

X 

CO 



2 

o 

li 

u-cr 
< I- 

00 

UJ 

2 




O CM K> tJ- (D N DO 0)< CD U QU O 

ooooo oo ooooooo «~ 

xxxxx xxxxxxxxx x 

ooooo oo ooooooo o 



CO 



X 

o 



SUBSTITUTE SHEET (RULE 26) 



WO 99/11065 



3/11 



PCTAJS98/17980 



FIG. 3 



CUE TO ACTIVATE 
EPG RECEIVED 






ENTRANCE 
CHECKS AB 


FUNCTION 
B AND VBB 



KEEP EPG AT 
REGULAR SIZE 



YES 



EXPAND SIZE OF EPG 
DISPLAY TO BLOCK VIDEO 
TELEVISION SIGNAL 




DO NOT 
BLOCK AUDIO 



BLOCK AUDIO 




DISPLAY EPG 



SUBSTITUTE SHEET (RULE 26) 



WO 99/11065 



PCT/US98/17980 



4/11 



FIG. 4A 



400 




MONITOR 



FIG. 4B 



405 




400 



MONITOR 



SUBSTITUTE SHEET (RULE 26) 



PCT/US98/17980 



5/11 



D 




SUBSTITUTE SHEET (RULE 26) 



WO 99/1 1065 PCT/US98/17980 

6/11 



FIG. 6 



TELEVISION 
SIGNAL FOR 



301 



OU 



PUT 



ID 

CHANNEL 



300 



CHANNEL 
INTERCEPT 
TABLE 



310 

INTERCEPT^ NO 
CHANNEL 



ADVERTISEMENT 
INTERCEPT 
TABLE 



,YES , 20 

INTERCEPT 
CTHIS ADVERTISEMENT 

o j^NO 



[YES 



i i 
i i 
i i 

f^-Z^ZZZZ^ZZz^ 

VIEWER 
PROFILE 
, DATABASE 



325 



INSERT CHANNEL 
CHANGE INSTRUCTION 
IN VBI OF SIGNAL 



330 

_J_ 

OUTPUT 
SIGNAL 



160 



SUBSTITUTE SHEET (RULE 26) 



WO 99/11065 



7/11 



PCT/US98/17980 




SUBSTITUTE SHEET (RULE 26) 



8/11 



PCT/US98/17980 



FIG. 7B 



N(J 



DECODE VBI 
OF 

CHANNEL A 



600 



610 

CHANGE"^ NO 
CHANNEL 

9 



630 

Z_ 

PROCESS 
SIGNAL FOR 
DISPLAY 



,YES 



TUNE 

- - TO" 
CHANNEL B 



620 



640 

'TIME TO^ 
RETURN TO 
CHANNEL 

9 





YES 


TU 
T 

CHAM 


NE 
0 

vIEL A 



650 



SUBSTITUTE SHEET (RULE 26) 



WO 99/11065 



PCT/US98/17980 



9/11 




Q_ 



2 L 



O 
LjJ 

a: 
a: 



Ld 

o 

LjjLi- 



< 

a: 



o 

Of 









o 


1 


CO 


O (/) 








RO 




Ql 



o 




SUBSTITUTE SHEET (RULE 26) 



WO 99/11065 



10/11 



PCT/US98/17980 



FIG. 9 



INCOMING 
SIGNAL 



500 



CHANNEL 
INTERCEPT 
TABLE 



f=r 

VIEWER 
PROFILE 



DATABASE , 



ADVERTISEMENT 
INTERCEPT 
TABLE 




550 

I 

PROCESS 
SIGNAL FOR 
DISPLAY 



ADVERTISING 
DATABASE 



PREPARE 
ALTERNATIVE 
DISPLAY 



T 



_5_3_5__J 



SUBSTITUTE SHEET (RULE 26) 



WO 99/11065 



11/11 



PCT/US98/17980 



CM 
If) 




SUBSTITUTE SHEET (RULE 26) 



5 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/US98/17980 



A. CLASSIFICATION OF SUBJECT MATTER 
IPC(6) :H04N 7/00 
US CL :348/l 

According to International Patent Classification flPC) or to both national classification and IPC 


B. FIELDS SEARCHED 


Minimum documentation searched (classification system followed by classification symbols) 
U.S. : Please See Extra Sheet 


Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 
none 


Electronic < 
none 


lata base consulted during the international search (name of data base and, where practicable, search terms used) 


C DOCUMENTS CONSIDERED TO BE RELEVANT 


Category 9 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


Y 


US 5,661,516 A (CARLES) 26 August 1997, column 3, lines 16-27 
and column 4, lines 18-35. 


1-8 ! 


Y 


US 4,635,109 A (COMEAU) 06 January 1987, column 8, lines 3- 
49. 


i-8 ; 


A 


US 5,162,905 A (ITOH et al) 10 November 1992, the abstract. 


1-8 


A 


US 4,864,429 A (EIGELDINGER et a!) 05 September 1989, the 
abstract. 


1-8 


| | Further documents are listed in the continuation of Box C. [~J See patent family annex. 


" Special categories of cited document*: 

"A" document defining the general stale of the art which is not considered 
to be of particular relevance 

*B" earlier document published on or after the alternations] filing date 

*L° document which msy throw doubts on priority claim (i) or which is 
cited to establish the publication data of another citation or other 
special reason (as specified) 

"0* document referring to an oral disclosure, use, exhibition or other 
means 

"P* document published prior to the international filing date but later than 
the priority data claimed 


"T" later document published after the international filing date or priority 
date and not in conflict with the application but cited to understand 
the principle or theory underlying the invention 

"X" document of particular relevance; the cleaned invention cannot be 
considered novel or cannot be considered to involve an inventive step 
when the document is taken alone 

* Y" document of particular relevance: the claimed invention cannot be 
considered to involve an inventive step when the document is 
combined with one or more other such documents, such combination 
being obvious to a person skilled in the art 

"A* document member of the same patent family 


Date of the actual completion of the international search 
12 NOVEMBER 1998 


Date of mailing of the international search report 

2 3 DEC 1998 


Name and mailing address of the ISA/US 
Commissioner of Patents and Trademarks 
Box PCT 

Washington, D.C. 20231 
Facsimile No. (703) 305-3230 


Authorized officer , »rf 

THAI TRAN 
Telephone No. (703) 305-4725 



Form PCT/ISA/210 (second shectXJuly 1992)* 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/US98/17980 



B. FIELDS SEARCHED 
Minimum documentation searched 
Classification System: U.S. 

U.S.: 348/1, 4. 5.5, 6. 7. 9. 10, 460, 474, 734; 358/908; 386/46. 
IPC(6): H04N 7/00, 7/10. 



Form PCT/lSA/210 (extra shectXJuly 1992)* 



This Page Blank (uspto) 



